A Riemannian Newton trust-region method for fitting Gaussian mixture models

نویسندگان

چکیده

Abstract Gaussian Mixture Models are a powerful tool in Data Science and Statistics that mainly used for clustering density approximation. The task of estimating the model parameters is practice often solved by expectation maximization (EM) algorithm which has its benefits simplicity low per-iteration costs. However, EM converges slowly if there large share hidden information or overlapping clusters. Recent advances Manifold Optimization have gained increasing interest. We introduce an explicit formula Riemannian Hessian Models. On top, we propose new Newton Trust-Region method outperforms current approaches both terms runtime number iterations. apply our on problems approximation tasks. Our very data with compared to existing methods.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Quasi - Newton Trust - Region Method

The classical trust-region method for unconstrained minimization can be augmented with a line search that finds a point that satisfies the Wolfe conditions. One can use this new method to define an algorithm that simultaneously satisfies the quasi-Newton condition at each iteration and maintains a positive-definite approximation to the Hessian of the objective function. This new algorithm has s...

متن کامل

A Parallel Quasi-Newton Method for Gaussian Data Fitting

We describe a parallel method for unconstrained optimization based on the quasi-Newton descent method of Broyden, Fletcher, Goldfarb, and Shanno. Our algorithm is suitable for both single-instruction and multiple-instruction parallel architectures and has only linear memory requirements in the number of parameters used to ®t the data. We also present the results of numerical testing on both sin...

متن کامل

A Fast Trust-Region Newton Method for Softmax Logistic Regression

With the emergence of big data, there has been a growing interest in optimization routines that lead to faster convergence of Logistic Regression (LR). Among many optimization methods such as Gradient Descent, Quasi-Newton, Conjugate Gradient, etc., the Trust-region based truncated Newton method (TRON) algorithm has been shown to converge the fastest. The TRON algorithm also forms an important ...

متن کامل

Gibbs sampling for fitting finite and infinite Gaussian mixture models

This document gives a high-level summary of the necessary details for implementing collapsed Gibbs sampling for fitting Gaussian mixture models (GMMs) following a Bayesian approach. The document structure is as follows. After notation and reference sections (Sections 2 and 3), the case for sampling the parameters of a finite Gaussian mixture model is described in Section 4. This is then extende...

متن کامل

Implicit Riemannian trust-region method for symmetric generalized eigenproblems

We have recently proposed a manifold-based trust-region method to compute extreme eigenpairs of symmetric matrix pencils [3]. The general optimization method had been shown [1, 2] to enjoy strong global and local convergence properties, which are inherited by its ”brute force” application to the extreme eigenproblem. However, the trust-region mechanism, which restricts the norm of the update in...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Statistics and Computing

سال: 2021

ISSN: ['0960-3174', '1573-1375']

DOI: https://doi.org/10.1007/s11222-021-10071-1